Curious Kids: How does the sun make such pretty colours at sunsets and sunrises?

We love watching all the pretty colours of sunsets and sunrises. But why does this happen, when most of the time the sky is just blue?